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Abstract 

The fluid model has proven to be one of the most effective tools for the analysis of stochastic 
queueing networks, specifically for the analysis of stability. It is known that stability of a fluid model 
implies positive (Harris) recurrence (stability) of a corresponding stochastic queueing network, and 
weak stability implies rate stability of a corresponding stochastic network. These results have been 
established both for cases of specific scheduling policies and for the class of all non-idling policies. 

However, only partial converse results have been established and in certain cases converse state- 
ments do not hold. In this paper we close one of the existing gaps. For the case of networks with 
two stations we prove that if the fluid model is not weakly stable under the class of all non-idling 
policies, then a corresponding queueing network is not rate stable under the class of all non-idling 
policies. We establish the result by building a particular non-idling scheduling policy which makes 
the associated stochastic process transient. An important corollary of our result is that the condition 
p* < 1, which was proven in jj^l to be the exact condition for global weak stability of the fluid 
model, is also the exact global rate stability condition for an associated queueing network. Here p* is 
a certain computable parameter of the network involving virtual station and push start conditions. 



1 Introduction 

In a series of papers, starting in the early 1990's, researchers established a strong connection between 

the stability of a queueing network and the stability of the corresponding fluid model. Initiated by 
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Rybko and Stolyar I^Hj and generalized by Dai [7], Stolyar and Chen [5, among others, it has been 
demonstrated that the stabihty of a fluid model implies stability of a corresponding queueing network. 
The stability results in the aforementioned papers were established both for classes of policies, e.g. the 
set of non-idling policies, and specific policies, e.g. First-In-First-Out (Dai [7j discusses both types of 
results). The fluid model is a continuous, deterministic analog of a discrete stochastic queueing network. 
It is defined through a set of equations which nominally take as parameters only the mean values of the 
random variables associated with the queueing network. 

Since the stability behavior of the fluid model is often significantly easier to analyze than that of 
the stochastic model, the results above have led to sweeping advances in understanding the stability 
of queueing networks via the fluid model. A short list of such papers includes ^ |HJ 13 llll 1121 116j . 
However, a major element needed for a satisfactory theory of stability via fluid models is a converse to 
the aforementioned stability results. Specifically: if the fluid model is not stable in some sense, does this 
imply instability of the corresponding queueing network? Unfortunately, it turns out that formulating 
an appropriate converse is a delicate matter. Partial converses which appear in the literature refer both 
to the fluid model and the fluid limit model, which is the set of weak limits of the rescaled stochastic 
process. Dai |S] introduces the notion of a weakly unstable fluid limit model. Roughly speaking, the 
fluid limit model is weakly unstable if there exists a uniform time at which all fluid limits which start 
at zero are strictly positive. If the fluid limit model is weakly unstable, Dai provides a concise proof 
showing that in the stochastic network, the queue length process diverges to infinity with probability 
one. This result provides a partial converse to the stability results mentioned earlier. Puhalskii and 
Rybko use large deviations methods to prove another partial converse to the stability theorems. 
Their result implies that if there exists an initial fluid model state for which all fluid trajectories with 
"close" initial states satisfy a uniform rate of divergence condition, then the queueing process is not 
positive Harris recurrent. Under stronger conditions on the fluid trajectories they prove transience of 
the queueing process. In two different papers, Meyn focuses on networks which can be represented 
by countable state Markov chains. In ^7], Meyn uses martingale methods to show that if all fluid 
limits eventually diverge at some uniform rate, then the state process associated with the queueing 
network is transient. Meyn ^H] uses Markov chain techniques to prove another transience result. In 
that paper, if the fluid limits satisfy a uniform homogeneity condition and a uniform lower bound for 
trajectories starting from some open set, this again implies that the state process for the associated 
queueing network is transient. In each of the papers ^\ and |18j . Meyn explains how the results can 
be extended to networks with more general state spaces. 
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In all of the papers above which prove a converse result to the original stability theorems in [IJ [71 
I21j . some uniform requirement over a set of fluid trajectories, or more precisely a set of fluid limits, 
(sometimes restricted to fluid limits starting from a particular type of state) is needed for the result 
to be applicable. Recall that the original stability results of Dai and Chen |1] require that all fluid 
trajectories are stable in some sense. Hence, we use the term "partial converse" above because there 
is some gap between the stability and instability results. To close the gap between the stability and 
instability results, one might consider analyzing directly the set of fluid limits. However, this approach 
presents certain difficulties, since the fluid limits are defined in a non-constructive way, as weak limits of 
the underlying stochastic process. Moreover, it is shown in Gamarnik that computing fluid limits 
of a queueing system is an algorithmically undecidable problem for a certain class of scheduling policies. 
In contrast, the fluid trajectories are defined by the set of solutions of a fluid model, a series of a fairly 
simple and reasonably tractable differential equations. It is this latter notion of fluid model which we 
use herein. 

In Chen [5, it is shown that a multiclass queueing network is globally rate stable if the corresponding 
fluid network is globally weakly stable (see Section [2. 2. 21 in this paper for definitions). In this paper, we 
present a result which is a full converse to Chen's stability result. It is a full converse in that for some 
networks, in particular two station networks, the result implies that the stochastic network is globally 
rate stable if and only if the corresponding fluid network is globally weakly stable. In particular, this 
implies that if there is just one linearly divergent fluid trajectory, then the stochastic network is not 
rate stable under some non-idling policy. Combining our main result with the result of Dai and Vande 
Vate |12j we show that a certain computable condition of the form p* < 1 is a necessary and sufficient 
condition for rate stability in networks with two stations. This is the first tight condition for stability 
for such a general class of networks. Our proof uses a series of large deviations estimates to establish 
the result and the only restriction in the stochastic network is that the estimates are applicable to the 
primitive stochastic processes defining the network. For a comprehensive discussion of various stability 
concepts in fluid and queueing networks, and the p* < 1 condition, we sugg est Dai [2]. 

It should be noted that a strength of the transience results in |H1 117| I19j is that they can be 
applied to networks under a class of policies or just one particular policy (like FIFO or a static buffer 
priority policy), whereas our result only applies to the class of non-idling policies. In other words, the 
advantage of the previous transience results is that they can be used to determine if a given network is 
stable under a particular scheduling policy. Our result can be used only to determine if there exists one 
scheduling policy, within the class of non-idling policies, which makes a network unstable. It should be 
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noted though that in general it is more difficult to apply the previous results because of more stringent 
requirements on the behavior of the fluid model trajectories. 

One is naturally led to ask if our result can be extended to apply to networks operating under 
a particular policy rather than the class of all non-idling policies. Unfortunately, a paper by Dai, 
Hasenbein, and VandeVate ^] essentially rules out the possibility of obtaining a full converse which 
can also be applied to particular policies. In that paper, it is shown that the stability of a queueing 
network under a fixed static buffer priority policy depends on more than just the mean value of the 
service and interarrival times. Hence, no mean-value based fluid model can sharply determine stability 
for the network considered, which implies that no general stability converse can be formulated for a 
network operating under an arbitrary, but specific policy. 

Our paper is organized as follows, in Sectionl^Jwe introduce stochastic and fluid multiclass networks 
and describe mathematical preliminaries. In Section |S1 we present the main results of our paper and 
their implications. All of the proofs are presented in Section 

2 Preliminaries — Model Description and Assumptions 

We start by describing the model of interest - a multitype queueing network. In the following subsection 
we describe a stochastic multitype queueing network and in Subsection l2.2l we introduce a fluid queueing 
network. 

2.1 Stochastic multitype queueing networks 
2.1.1 Network description 

A open stochastic multitype queueing network is a network of J stations ai, (T2, . . . , ctj each processing 
one or multiple types of jobs. For each type z = 1, 2, . . . , / there is an external stream of jobs arriving 
to the network. The intervals between successive arrivals of jobs corresponding to type i are given by 
the i.i.d. sequence X\, . . . XI., .... If E[Jr5^] exists, we deflne Aj = 1/E[X5^] to be the arrival rate 
for type i. More detailed assumptions about the stochastic processes {XI., k = 1,2,...} are provided 
later. We denote by Ai{t) the cumulative arrival process which counts the number of arrivals up to 
time t. That is Ai{t) = max{A; : ^j.<k -^l- — 

Each job of type i has to be processed on a fixed ordered sequence of stations a{i, 1), cr{i, 2), . . . , 
a{i, Ji), where each a{i, I) is one of the stations ai, . . . , aj. We refer to {i, 1), {i, 2), . . . , {i, Ji) as stages 
corresponding to the type i. We allow the repetition of stations, i.e. a{i,j') = a{i,j") for / ^ j", 
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meaning some jobs need to be processed on the same station multiple times (which is common in some 
manufacturing environments). In particular Jj could be bigger than J. We slightly abuse the notation 
sometimes by using a to also denote the set of classes which are served at station a. 

Each station a = aj,j < J has one server and, in particular, can work on only one job at a time. 
Other jobs awaiting processing on a accumulate into queues. Type i jobs in the queue corresponding 
to stage will be referred to as class jobs. Once a job of class is processed, it is moved 
into the next queue + 1) at the station a{i,j + 1), or leaves the network if j = Ji. The processing 
times for jobs of type i at stage j are random and are given by the i.i.d. sequence , ■> ■ ■ ■ ■> ■> ■ ■ ■ ■ 
If E[S^*^'-'] exists, we define fiij = 1/E[S'^'-'] to be the service rate for jobs in class Again, more 

detailed assumptions regarding the stochastic processes {■S'^'"', A; = 1,2, . . .} are provided later. 

Let d = Ji denote the total number of classes in the network. We denote by Q{t) = {Qij{t)) € 
the vector of queue lengths in our queueing network at time t > 0. In order to completely specify the 
stochastic dynamics of Q{t) we need to specify the vector of initial queue lengths q = Q(0) and the 
scheduling policy lA which gives gives the protocol at each station a for resolving the contention for 
service, when several jobs are competing for the same station. Some common policies include the 
First-In-First-Out (FIFO) policy which gives priority to jobs which arrived earlier to the station, Last- 
In-First-Out (LIFO) defined analogously, Global-FIFO (GFIFO) which gives priority to jobs which 
arrived earlier into the entire network (based on time stamps of a job's arrival to class {i, 1)), and static 
buffer priority policies which are based on a ranking of classes in each station and give priority to jobs 
with the higher ranking, etc. All of these policies are examples of non-idling policies, which are defined 
as policies that require each station a to work at full capacity as long as there are any jobs waiting to 
be processed by a. 

Throughout the paper we will be only considering head-of-the-line (HOL) type non-idling scheduling 
policies. Under a HOL policy, at most one job of each class at a given station can receive service at 
a given time. Furthermore under the HOL assumption, jobs are served in FIFO order within a given 
class. FIFO, Global-FIFO and static buffer priority are examples of HOL policies. Adopting the HOL 
assumption in this paper is really not a restriction since the main goal of this paper is to construct an 
unstable (in a sense to be defined) non-idling scheduling policy. Indeed we construct an unstable policy 
which happens to be of HOL type. In addition to being HOL, the policy we use to prove the main result 
is preemptive resume. Under such a policy if the processing of a job of class i is interrupted to serve a 
job from another class j, then the class i job is ejected from service and placed at the head of the line 
for processing at a later time. When class i is again chosen for service, the remaining processing time 
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for the ejected job is the same as it was at the moment it was ejected. 

For each (g, zi, z^) G 'L'^ x '^^'^ we say that the state of the stochastic process at time t is (g, zi, Z2) 
if at time t the vector of queue lengths Q{t) is g, the vector of residual interarrival times is z\ (hence 
the dimension / for this component of the state) and the vector of residual service times is Z2- For 
many scheduling policies, including the policy constructed in this paper, the state space x IS 
adequate to describe the underlying stochastic process of the network. 

For each class let Tjj(t) denote the total amount of time station cr(i,j) spent processing class 

jobs during the time interval [0,t]. Let Dij{t) denote the cumulative departure process for class 
jobs, that is Dij{t) is the number of class jobs that station aij processed during the time 
interval [0,t]. For each station a, let Q„{t) = Yl^i j)ecTQi,j{'^) ^'^^'^ ^o-(i) = "^^^ 
following relations follow immediately from the definitions. For all 1 < i < /, 2 < j < Jj and t > 

Qi,iW = Qu(o) + Ai(t)- (1) 
Q^At) = QiA^) + - (2) 

£>i,, (t) = max{A; : ^ S\:^ < T,,, (t)}. (3) 

r<k 

Also for every < ti < t2 ^-nd every station a 

{T,j{t2) - Tijih)) <t2-ti. (4) 

(«.i)G(T 

Finally, if the scheduling policy U is non-idling, then for every < ti < t2 and every station a, if 
Qfj{t) > for all ti < t < t2 then T„{t2) — T„{ti) = t2 — ti. In other words, if the total queue in station 
a was always positive during the time interval [ti,t2]) then the station was always working on jobs full 
time during this interval. 
Let 

Amax = max{Ai, A^^}, (5) 



/^max = max{/Xjj, /i. ]}, (6) 
I. J '-I 



^max = max{Ji}. (7) 

For technical purposes we introduce C - a very large constant which exceeds all the parameters of the 
network. Specifically, 

C > 13(Amax + /^max)^-^>^max- (^) 



For any station cr, let \a\ denote the number of classes in the set a. For any vector g S we let 
\\q\\ = ^i<,j<(il9i| denote the Li norm. For any non-decreasing non-negative function f{t) and any 
ti < t2 we let f(ti,t2) denote /(t2) — /(^i)- 

2.1.2 Stochastic Assumptions 

Below, we introduce some basic assumptions on the sequences of random variables which represent the 
primitive data in our stochastic networks, and an assumption on the behavior of the network process 
itself. 

Definition 1 Consider a sequence of i.i.d. non-negative random variables Zi, Z2, ■ ■ ■ , Zn, ■ ■ ■ with 
E[.Zi] = a < 00. Such a sequence satisfies large deviations (LD) hounds if for every e > there 
exist constants L = L{e), V = V{e) > such that for any z > 

P II Zi-z-an >en Zi>z\< Fe"^", (9) 

V l<i<n / 

for all n>l, and the counting process N{t) = max{?i : Zi + ■ ■ ■ + Zn < i} satisfies 

Ar(i-hz) - A > Zi>^<Ve~^\ (10) 

for all t > 0. 

It is important that the constants L, V in the definition above do not depend on z > 0. This 
uniformity will become useful when we analyze arrival and service processes with the presence of some 
residual interarrival and service times. For simplicity we assume common constants L = L{e), V = V{e) 
instead of individual constants corresponding to indices i,j. Our main stochastic assumptions are as 
follows. 

• Assumption A: The sequences {X^,n = 1,2,...} and {Sli^,n = 1,2,...} are i.i.d. for every 
1 < i < / and 1 < j < Ji. 

• Assumption B: For each i,j the large deviation bound © holds for the sequences {X^,n = 
1,2,...} and {S^f ,n = 1,2,...} and (|10j) holds for the associated renewal processes. 

• Assumption C: For every state {q, zi,Z2), every n > we have r = inf{t : ||Q(t)|| > n | Q(0) = 
{q, zi, Z2)} < 00 with probability one, under any scheduling policy. 
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One way to verify assumption B is via the following sufficient condition for the large deviations 
bounds to hold for i.i.d. sequences. 

Lemma 1 Suppose Zi, Z2, ■ ■ ■ , Zm, ■ ■ ■, is a non-negative i.i.d. sequence with ^[Zi] = a such that 
there exists a function F{9),6 > taking values in U {00} which is finite on some interval [0,6q] 
and which satisfies 

supE[e^(^i^^) \Zi>z]< F{e), (11) 

z>0 

for every 6 > 0. Then this sequence satisfies the LD bounds ^ and U(J\) . 

The proof of Lemma ^ is provided in the Appendix. It is simple to check that condition (|11() is 
satisfied by many distributions including the exponential, Erlang, and any distribution with bounded 
support. Note that, by setting z = 0, condition (jllj) implies that the distribution of Zi has a moment 
generating function for 9 S [0,^o]- 

Assumption C is intentionally broad, in that it does not involve the stochastic primitives directly. 
The assumption holds for a wide range of distributions, given assumptions A and B. For example, if at 
least one of the service time distributions has unbounded support, then assumption C holds. However, 
assumption C holds under even weaker conditions. 

We adopt assumptions A, B, and C for the remainder of the paper. Whenever we talk about the 
probability !?{•} of any event, the probability is understood with respect to the stochastic processes 
{Xl^, Sli^}. If the vector of initial queues Q{0) is a random vector itself, then the probability is also 
with respect to the probability distribution of Q{0). 

2.1.3 Stability and rate stability 

One of the main features one desires to have in a multitype queueing network is stability. Various equiv- 
alent definitions of stability have been used in the literature, among which positive Harris recurrence is 
one of the most commonly used definitions. Under the condition that the interarrival times {X^.} are 
unbounded and spread out (see jjj), then positive Harris recurrence is defined as follows. 

Definition 2 A multitype queueing network operating under a scheduling policy U is defined to he 
Harris recurrent if there exists 6 > such that for any initial vector of queue lengths <5(0), the time 
T = inf{t : ||Q(i)|| < h} is finite with probability one. The network is defined to be positive Harris 
recurrent or stable, if in addition E[r] < 00, where the expectation is conditioned on the initial vector 
of queue lengths Q{0). The network is defined to be globally stable if it is stable for every non-idling 
scheduling policy U. 
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The positive Harris recurrence property, under some additional technical assumptions, implies the ex- 
istence of a unique stationary distribution for the queue length process Q{t). 

A somewhat weaker definition of stability is rate stability. This is the form of stability we are 
primarily concerned with in this paper. 

Definition 3 A multitype queueing network operating under a scheduling policy U is defined to be rate 
stable if for every type i, limt^oo = A,, a.s. The network is defined to be globally rate stable if 

it is rate stable for every non-idling scheduling policy U. 

In words, rate stability means with probability one the arrival rate is equal to the departure rate. 
Prom and rate stability implies limt_^oo = Aj and limj_>oo ^'f^ ^ = a.s. for all i,j. In 

other words, for a rate stable system, even if the total queue length ||Q(t)|| diverges as t goes to infinity, 
it grows at most at a sub-linear rate a.s. 

2.2 Fluid model 
2.2.1 Fluid equations 

Fluid models are continuous deterministic counterparts of stochastic queueing networks, intended to 
capture the most essential dynamic properties of the queue length process. The term fluid model is 
sometimes used interchangeably with the terms "fluid limits" and "functional law of large numbers." 
For many types of queueing networks (see, e.g. jTj, [10], [S], it has been established that the 
rescaled queue length process Q{nt)/n for a large scaling parameter n converges weakly to a certain 
continuous deterministic process, satisfying a series of functional equations, which we describe below. 
To avoid confusion we define the fluid limit model to be the set of weak limits of Q{nt)/n as n — > oo, and 
we define the fluid model to be the set of solutions of the system of equations below (formal definition 
follows) . Then the set of fluid limits is a subset of the set of solutions to the fluid model. 

Given a multitype queueing network with arrival rates Aj and service rates /ijj, the corresponding 
HOL fluid model (or fluid network) is defined by the following system of equations and inequalities with 
time dependent variables Qij{t), Ai{t), Dij{t),Tij{t),t > 0. We first provide the system of equations 
and inequalities, and immediately after we give a physical explanation for each of these equations. For 
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every i = 1, . . . ,I,j = 1, 2, . . . , Jj, a = ai, . . . , aj, t > and < ti < t2 



Q^,l{t) = Qi,m + Mt) - A,i(t), (12) 

Q^Ai) = <5^,i(0) + A,i-l(t) - Dij{t), (13) 

Mt) = \it, (14) 

Di,j{t) = fiijfi^t), (15) 

(fij(t2) - Ti,j(ti)) <t2-tu (16) 

gij(t),ii(t), Aj(t),Ti,,(t) G K+. (17) 



In addition, for all i,j,Tij{t) is a non-decreasing function of t and ^jj(O), Tjj(0) = 0. 

The value of Qij{t) represents the total amount of fluid present in buffer at time t. We also 
refer to it as class (i,j) fluid. Ai{t) represents the total amount of fluid corresponding to type i, that 
arrived externally during the time interval [0,t]. The fluid arrival process is assumed to be linear with 
rate Aj, hence (fTl)) . Dij{t) is the amount of class fluid that was processed by station cr{i,j) during 
[0,t]. Tij{t) represents the portion of the time interval [0, t] that station cr(i,j) spent processing class 
fluid. The inequality (jlbj) enforces the physical constraint that any given station can spend at 
most 100% of its time processing fluid. 

Equations (|12j) and (|13|) are simply flow conservation equations: all class — 1) fluid becomes 
class fluid after processing, for all j < Ji, and class (i, Ji) fluid leaves the network after processing. 
The last constraint H17|) simply says that all the variables involved are non- negative real numbers. Note 
that only the expectations l/Aj = E[X^] and ^/fJ-ij = ]E[S^'-'] of interarrival and service times appear 
in the fluid model. The higher order moments of the network primitives are not reflected in the model. 

For each station a we let 

Qa{t)= Yl '3i,i(i), (18) 

(«j)6o- 

that is, Qa{i) is the total fluid level in station a at time t. Also let 

f^{t) = Y ^'^A^- (19) 
(«j)eo- 

So, Ta{t) is the total amount of time station a spent processing fluid during the time interval [0,t]. 
Equivalently, Ia{t) = t — T(j{t) represents the cumulative amount of idling experienced by station a 
during the time interval [0,t]. 
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^From inequality (|16() it follows that the function Tij{t) is Lipschitz continuous. Using equations 
(|12|1 -(|17 |) it can be checked that all of Qij{t), Ai{t), Dij{t),Tij{t) are also Lipschitz continuous. Any 
solution {Qij{t), Ai{t), Dij{t),Tij(t)) of the system of equations and inequalities ((T^ - H17|) is defined to 
be a fiuid solution. For simplicity, henceforth we use {Q{t),T{t)) to denote a fluid solution, where Q{t) 
and T{t) stand respectively for vectors {Qi,j{t)) and {Tij{t)). A fluid solution {Q{t),T{t)) is defined to 
be non-idling if for every station a, Ia{t) increases only at times t when Qa{t) = 0. Formally, the fiuid 
solution is non-idling if for every station a 

POO 

/ Q^it)dl^{t) = 0. (20) 
Jo 

The integral is well-defined because Ia{t) is a Lipschitz continuous function and, as a result, is almost 
everywhere differentiable in with respect to the Lebesgue measure on 

Definition 4 The set of non-idling feasible solutions to the system of equations ^2U\) is defined 

to be the non-idling fiuid model. 

When a queueing network operates under a specific scheduling policy, for example, under a fixed 
buffer priority policy, additional constraints can be added to the fiuid equations in order to reflect the 
policy. In this paper we are only considering the case of all the non-idling policies, and thus the non- 
idling fluid model defined is the one of interest. For the remainder of the paper we drop the modifier 
"non-idling" and simply refer to the "fiuid model." 

The following lemmas are used later in the paper. The proofs of both lemmas are straightforward 
and thus omitted (note that Lemma 01 appeared as Property 2 in Chen |^). 

Lemma 2 Suppose {Q{t),T{t)) is a fluid solution defined over a time interval [0,0]. Then Q'{t) = 
Q(0) + UQ(.G) - Q(0)),T'(t) = |T(0) defined over [0, 0] is also a fluid solution. Moreover, suppose 
the solution {Q{t),T{t)) is non-idling and for every station a either Q^it) > for all t € [0,^] or 
Qo-(O) = Q(t{Q) = 0. Then the solution {Q'{t),T'{t)) is also non-idling. 

Lemma 3 Suppose {Q{t),T{t)) is a non-idling fluid solution defined over a time interval [0,9]. Then 
for any /3 > 0, Q'{t) = /3Q{(3^^t), T'{t) = j3T{[5^^t) is a non-idling fluid solution defined over the 
interval [0, 136] . 

In the proofs in later sections, we need to define certain types of fluid models with a finite decom- 
position property. We define this notion below. 
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Definition 5 A fluid model is defined to satisfy the Finite Decomposition Property (FDP) if there exist 
values u,B > 0, with the following property. For every non-idling fluid solution {Q{t),T{t)) defined over 
an interval [0,0] such that Q{t) ^ on this interval, there exist a non-idling fluid solution (Q(t),T(t)) 
also defined over [0, 6] and a sequence of times instances = to < ti < t2 < ■ ■ ■ < tM = d such that 

1. M < zy(9 supo<t<0 yiQ^ + B and info<f<0 | | > info<t<0 

2. Q{tm) = Q{tm) for all m = 0,1,... ,M. 

3. For each interval (tr, t^+i), < r < M — 1 and each station a either Quit) > for all t € {tr,tr+i) 
or Q(j{t) = for all t G (t^jtr+i)- 

The next proposition shows that the FDP requirement is not restrictive for fluid models arising from 
two station networks. 

Proposition 1 Fluid networks with two stations (J = 2) satisfy FDP. 

Although we only consider multitype fluid networks in this paper, the proposition actually holds for 
any two station fluid network, for example networks with proportional routing. This general form of 
Proposition n is proved in Subsection 14.21 At this point we do not know whether FDP holds for general 
networks (i.e. with J > 2). 

2.2.2 Global stability and global weak stability 

Just as for stochastic queueing networks, we can define stability and global stability for fiuid networks. 

Definition 6 A fluid solution [Q[t),T{t)) is defined to he stable if there exists a r < oo such that 
Q{t) =0 for all t > T. A fluid model is defined to be globally stable if there exists a t < oo such that 
every non-idling fluid solution {Q{t),T{t)) satisfying ||0(0)|| = 1 also satisfies Q{t) = for all t > t. 

Remarks : 

1. The condition ||Q(0)|| = 1 in the definition above is a necessary scaling condition. One cannot 
have a uniform emptying time r without a bound on the initial state. 

2. The definition of global stability is somewhat different from the perhaps more natural: "network 
is defined to be globally stable if it is stable for all non-idling policies." While it is possible that both 
definitions are equivalent and it is known to hold in many cases, it has not yet been established in 
general. Definition El is used more often because it simplifies certain technical considerations. 
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Below, we define a stability notion for fluid networks which is the analogue of the rate stability 
definition for stochastic networks. 

Definition 7 A fluid model is defined to be globally weakly stable if for any non-idling fluid solution 
{Q{t),f{t)), 0(0) = implies Q{t) = for all t > 0. 

In words, a fluid model is weakly stable if one cannot construct a non-zero fluid solution which 
starts from zero. We did not introduce the notion of a weakly stable fluid solution, since this would 
just mean introducing a trivial Q{t) = solution (also it is easy to check that Q{t) = for all t implies 
r,,,(t) = |t for all (i,j)). 

2.3 The connections between stochastic and fluid queueing networks 

The most immediate connection between a stochastic network and the corresponding fluid queueing 
network is provided by the results of Dai |7j and Stolyar Roughly speaking, they show that for a 
broad class of scheduling policies, if a stochastic network is operating under a policy U, each weak limit 
Q{t) = lim„ Q^I!^l and T{t) = lim„ Zil^l of the stochastic queue length process Q{t) and cumulative 
work process T(t), with a sequence of initial states Q{0) = [nj\, where 7 is a fixed positive constant, 
is a deterministic continuous function {Q{t),T{t)) which is a fluid solution of the corresponding fluid 
model. If the policy U is non-idling, then each obtained fluid solution is also non-idling. Thus, the 
queue length process after an appropriate rescaling using certain scaled initial states, converges to a 
fluid solution. 

This rescaling process provides the basic tool for connecting the stability of stochastic and fluid 
networks. In fact, this connection was the primary motivation for introducing fluid model techniques 
|2f)j . The following theorem establishes a fundamental relationship between the stability of the stochastic 
and fluid models. 

Theorem 4 (Dai Q/, Stolyar Consider a multitype queueing network. If the corresponding fluid 
model is globally stable then the stochastic network is globally stable. 

The theorem actually holds for a broader class of networks and also for networks operating under 
specific scheduling policies. If one is given a particular scheduling policy U, one can sometimes identify 
additional constraints that the fluid limits lim„ Q{nt)/n must satisfy. 

More relevant to the topic of the present paper is the following related result. 
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Theorem 5 (Chen ^) Consider a multitype queueing network. If the corresponding fluid model is 
globally weakly stable then the stochastic network is globally rate stable. 



Our understanding of global stability and global weak stability is fairly complete for fluid models 
corresponding to queueing networks with two stations (J = 2), thanks to the results of Bertsimas et al. 

and Dai and Vande Vate Both of these papers obtain necessary and sufficient conditions for 

global stability of fluid networks for the case J = 2. Moreover a certain parameter p* is introduced in 
jl2j . This parameter is called the maximum virtual traffic intensity. It is shown that the fluid model is 
globally stable iff < 1 and is globally weakly stable iff p* < 1 . The condition p* < 1 then implies rate 
stability of the underlying stochastic network by Theorem [5J One of the main results of our paper is 
to establish a converse: p* > 1 implies the stochastic network is not globally rate stable. In particular, 
p* < 1 is the tight global rate stability condition for multitype networks with two stations. 



In this section, we provide the main results and corollaries of this paper. All proofs, along with the 
needed lemmas, are provided in Section 0] Our first result concerns the structural properties of non- 
idling fluid solutions. The result is introduced primarily because it is needed to prove the main result of 
the paper, but we believe that it is interesting in its own right and thus state the result in this section. 

Theorem 6 Suppose the fluid model of a multitype queueing network is not weakly stable. Then there 
exists a positive constant 7 > such that for any initial state q G 3^*^, there exists a non-idling fluid 
solution {Q{t),T{t)) satisfying Q{0) = q and \ \Q{t)\ \ > ^t for all t >0. Namely, the solution is linearly 
divergent. Moreover, this solution satisfies 



where C is defined by 

Intuitively, the notion of a fluid model not being weakly stable seems weaker than linear divergence. 
In particular, a fluid model is not weakly stable if there exists a solution which "pops up from zero" 
at some point, after starting in the zero state. Theorem |H1 shows that if one solution pops up, then 
a different solution can be constructed which diverges to infinity linearly, i.e. we construct a stronger 
fluid solution (in the sense of instability) from a seemingly weaker solution. This stronger fluid solution 



3 Main Results 




(21) 
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can then be used to infer the instabihty of a class of associated stochastic networks. Finally, we note 
that the divergent solution can be constructed from any initial state (5(0) = (7 S 5?+, including the zero 
state. 

We are now prepared to state the main result of the paper, which connects the instability of fluid 
models and stochastic networks. 

Theorem 7 Consider a multitype stochastic network satisfying Assumptions A, B, and C. Suppose 
the associated fluid model is not globally weakly stable, and satisfies FDP. Then, for any initial state 
(q, zi, Z2) G Z^J, X 5?^+"^, there exists a non-idling scheduling policy for which the resulting queue level pro- 
cess satisfies liminf(_^oo > with probability one. In particular, the stochastic process associated 
with the queueing network is unstable, under some non-idling policy. 

The rate of divergence to infinity implied by the theorem above will be explicit. We will show that 
constructed policy results in 

t 8max(l,|) 

with probability one. The import of Theorem EJ is more apparent from the corollaries provided below. 

Corollary 1 Consider a multitype stochastic network with J = 2. If the associated fluid model is not 
globally weakly stable, then the queueing network is unstable in the sense that liminft^oo "^f-"' > 
with probability one from each initial state under some non-idling scheduling policy. 

Corollary n follows from TheoremQand Proposition^ which states that FDP holds for fluid networks 
with two stations. Recall that one motivation for our work is the stability Theorems |1] and [5J Thus 
Corollary n provides a complete converse of Theorem [5] for two station multitype networks. A missing 
piece in the theory for general J is to determine if all fluid models satisfy FDP. If such a result holds, 
then Theorem [7] would imply a converse for networks with an arbitrary number of stations. 

We note also that Theorem [S] is valid when we consider fluid and queueing networks under specific 
scheduling policies. However, for networks operating under specific policies (rather than a class of 
policies) a general converse to the theorems of Chen and Dai is not possible as demonstrated in |lflj . 

Dai and VandeVate [12j derived explicit necessary and sufficient conditions for global weak stability 
of fluid models of multitype networks in terms of a certain parameter p* related to the so-called virtual 
traffic intensity and push start conditions. They prove that such fluid networks are weakly stable iff 
p* < 1. Considering Theorem [S] along with Corollary Q those results now yield complete necessary and 
sufficient conditions for rate stability of two station stochastic mutlitype networks. 
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Corollary 2 A stochastic two station multitype network is globally rate stable if and only if p* < 1. 

4 Proofs of Main Results 

In this section we provide all of the proofs of our main results. The first proof, of Theorem |H1 shows 
that if the fluid is not globally weakly stable, there exists a linearly divergent fluid solution. 

4.1 Linearly divergent fluid solutions 

Proof : [Proof of Theorem E] We assume in the theorem that a given fluid model is not globally 
weakly stable. Hence, there exists a non-idling solution which satisfies 0(0) = and Qito) ^ for some 
to > 0. First note that, without the loss of generality, we may assume that Q{t) ^ for all < t < to- 
Otherwise, we can find t = sup{0 < t < to • Q{t) = 0} and consider the fluid solution on [t,to] only. 
Note that t < to by the continuity of Q{t) and the fact that Q{to) ^ 0. Next, using LemmaOlwith some 
/? > we can obtain a new solution defined on [0,/5to] with Q'{0) = and ||Q'(/3to)|| = /3||Q(to)||. If we 
set f3 = tg ^ then we have a solution defined on [0, 1] with Q'{0) = and ||(5'(1)|| = ||0(^o)||Ao- Hence, 
again without loss of generality, we set to = 1, i.e. we assume we are given a non-idling solution with 
0(0) = and 0(1) 7^ 0. 

We now build a new fluid solution by constructing it iteratively over the intervals [0, 1), [1, 2), [2, 4), 
[2", 2""'"^), . . . . We denote the solution that is constructed in this manner by {Q°{t),T°{t)). For 
the initial interval [0,1), consider our initial fluid solution Q{t) satisfying 0(0) = 0,0(1) 7^ 0. We 
first modify the solution by setting 0(0) = q, where q € Next for every t < 1 and every class 
on the interval [0,t] we spend exactly Tij{t) time units processing class {i,j) flow, plus whatever 
necessary additional amount is required to make the solution non-idling. In other words, we can think 
of the flow "created" and "processed" by the non-weakly stable solution Q{t) as high priority flow, 
and the remaining flow as low priority flow. Note that the allocation of the additional processing 
effort required is not necessarily uniquely determined by the original allocation T{t). In any case, the 
resulting solution satisfies 0^(0) = q and Q°j{t) > Qijif) for all classes (i,j) and t < 1. In particular, 

||0''(i)ll> 110(1)11 >o. 

Assume now the solution has been constructed over the time horizon [0, 2"] for n > 0. We now 
extend it over [2", 2*^"^^]. The idea of the construction is similar to the first interval, except that we 
"stretch" the original solution Q{t) by a factor of 2" and then use this solution to extend our current 
solution by defining it on [2", 2""'"^]. That is, consider the scaled solution {f3Q{(3~^t), l3T{f3~^t)) with 
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(5 = T. This solution is defined over t G [0,2"). Next, for each t G [2^,2"+^] let T°{t) be defined 
by T°{t) — T'°(2") = 2"T'(2~"(t — 2")) plus any extra processing effort required to make the solution 
non-idling. 

It can be easily checked that the resulting solution Q°(t) satisfies Qij{t) > 2"(5jj(2~"(t — 2")) for 
aUiG [2",2"+i] and ah i,j which implies \\Q°{t)\\ > 2"| |Q(2-"(t - 2"))| |. In particular, ||Q°(2"+i)|| > 
2"||Q(1)||. 

We have constructed a non-idling fluid solution Q°{t) which diverges to infinity at time instances 
tn = 2",n = 0, 1, ... . To complete the proof of the theorem, we show that for some constant 70 > 0, 
> 7o2" for all t G [2", 2*^+-^]. First let us show that this implies the theorem. For any t > 
find the largest integer n such that 2" < t, i.e. let n = Llog2iJ- We have ||0°(i)ll > 7o2" > jo2^°^2t-i ^ 
7oi/2. Setting 7 = 7o/2, we obtain the result. 

To show the existence of 70, note that for any ti < t2 and any feasible fluid solution Q(') we have: 



This implies that for all t G [2", 2" + 2"-i||Q(l)||/(2C)], Q°(t) satisfies: 

imm > iig°(2")ii-c(t-2-) 

> 2"-i||Q(l)|| -C(t-2") 

> 2"-2||Q(l)||. 

If 2" + 2"-i||Q(l)||/(2C) > 2"+\ then we simply set 70 = (1/4)||Q(1)||. Otherwise, let 



This minimum exists since Q{t) is continuous and it is positive since ||Q(i)|| > for all < t < 1. 
Then, for all 2" + 2"-i||Q(l)||/(2C7) < t < 2"+^, we have \\Q°{t)\\ > 2"||Q(2-"(t - 2"))|| > 2"7i. We 
take 7o = min{(l/4)||(5(l)||,7i} and we have proven the first inequality in the theorem statement. 

The last part of the proposition follows almost immediately. Using H23|) with ti = and t2 = t we 
have \\Q{t)\\ > \\q\\ - Ct > \\q\\/2 for t < \\q\\/{2C). On the other hand, by construction, ||0(t)|| > 
7^ > 7I l/l^C*), whenever t > ||g||/(2C). This completes the proof of the theorem. □ 

Theorem 1^1 will be used for proving our main result, Theorem[71 Specifically, we will construct a non- 
idling scheduling policy for the discrete network which, with high probability, results in a trajectory 



\\Q{t2)\\ > ||Q(ti)||- Yl t^^.hit2-ti) 



l<i<I 



> \\Q(ti)\\-C{t2-h). 



(23) 
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very close to the fluid trajectory built in the proof of Theorem |SJ We will use the large deviations 
bounds Q and (|lfl|) multiple times to obtain bounds on the deviation between the fluid and stochastic 
trajectories. 

4.2 FDP in fluid networks with two stations 

Proof : [Proof of Proposition ^ Consider a network with two stations, cJi and cr2, and suppose we 
have a non-idling fluid solution {Q(t),T(t)) which is non-zero over time interval [0,^]. By continuity, 
info<t<6( ||Q(i)|| > 0. The next result follows from Proposition 1 in |T]. There exists a nondecreasing 
sequence such that supj ti = and such that for all times less than 9 the following hold: 

• QaiiUm+l) > 0,Qa2{Um+l) = and for t e [Um+l,t4m+2], Qai{t) > 0; 

• QaiiUm+2) > 0,Qa2{tAm+2) = and for t G {Um+2,t4m+3), Ocri (t) , 0<t2 (*) > 0; 

• QaiiUm+s) > 0,Qai{tAm+3) = and for t € [Um+3,t4m+A], OtJa (0 > 0? 

• QaiiUm+A:) > 0,Qai{Um+4) = and for t G (t4m+4,*4m+5), O^i (*) , 0(72 (0 > 0. 

Moreover, one of ti, i = 1, 2, 3, 4 is equal to zero. When t2, ts or t4 is zero, ti with lower value of i is 
not defined. 

The characterization above essentially divides the trajectory of a fluid solution into four different 
segments. On the segment of the trajectory between t^m+i and tim+2, the trajectory is either on the 
boundary of the state space (where Q(y^{t) = 0) or in the interior of the state space. We next claim 
that such a segment can be "linearized" such that it remains a non-idling solution, yet (t) = for 
all t G [tAm+i,t4m+2]- In other words, the linearized solution is on the boundary for the entire interval. 
To achieve the linearization we define 

Q{t) = 0(*4m+l) + — tjrr^ [Q{tim+2) - QiUm+l)] and 

E4m+2 — I4m+1 

f(t) = T{tim+l) + [T(t4m+2) — T{t4rn+l)], 

*4m+2 — t^rn+l 

for all t G [t4,m+i,t4m+2]- Using Lemma|2lit follows that the new solution {Q{t),T{t)) is both feasible 
and non-idling, given that the original solution was also. In a similar manner, we linearize the fiuid 
solution {Q{t),T{t)) on all intervals of the form [t4m+3,tAm+4]- Hence, in each interval the new solution 
remains on one of the axes, unless it is crossing the interior, from one axis to the other. 
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We now demonstrate that {Q{t),T{t)) has the properties described in Definition |3 First, we claim 
that for each m, 

Ws - Wi > inf t4,n+3 - > -mi \\Q{t)\\/C. (24) 

Indeed, by construction Qaiit^m+i) > 0, (5a2(i4m+i) = and (3(72(*4m+3) > 0,Qaiit4m+3) = 0. In 
particular 

QaAUm+l) = ||Q(Wl)ll > il?f IIQWII > i^lJlOWII > 0- 

Note that total rate at which fluid can depart from a given station is bounded above by j < C*. 
Thus, since Qaiit^m+s) = 0, we have t^rn+s — t^m+i > info<t<6» ||(3(i)||/C'- An analogous argument 
demonstrates that t^m+s — i4(m+i)+i ^ info<t<0 ||Q(i)||/C- Since the interval lengths are bounded 
strictly away from zero, the total number of points ti in [0,9] is at most {29 C / info<t<6) ||0(i)||) + 2, 
where the +2 accounts for the end points of [0, 9]. Setting v = 2C, B = 2 yields the first FDP property 
(1). Properties (2) and (3) are automatically satisfied by our construction of (Q(t),T(t)) above. □ 

4.3 Transient paths in the stochastic network 

Most of this subsection is devoted to the proof of Theorem of Section 14.41 which, as we will show, 
implies the main result of our paper, Theorem[71 In the proof we repeatedly use probabilistic bounds of 
the form c\ exp(— C2n), where ci, C2 > are constants which depend on the parameters of our queueing 
network and n is a scaling parameter which takes on a large value. In various expressions, C2 is usually 
related to the constant L appearing in the large deviations bounds in @ and (|10() and the network 
parameters Xi,fXij, \I\,C, as well as parameter 7 introduced in TheoremEl We will also be considering 
finite sums of the bounds of the form c'^ exp(— cin) + c'2 exp(— 02^) + ... + exp(— Cmn). In general the 
Ci, c[ take on different values and m is a constant, independent of n. Such sums can be bounded above 
by c'exp(— cn) for c = mini<fc<mCfc and c' = X^c^. 

In our proofs, the actual values of the constants are not important, only the fact that they are 
independent of n. Therefore, to simplify the exposition, we simply use the notation 0(exp(— 0(n))) 
and we write expressions like 0(exp(— 0(n))) + 0(exp(— 0(n))) = 0(exp(— 0(n))) where the standard 
notations O(-) and 0(-) hide the actual constants c and c'. 

4.3.1 Proof Preliminaries and the Scheduling Policy U 

In order to precisely state the next series of detailed results, we need to define a non-idling policy lA. 
The definition of this policy involves a number of preliminary observations and definitions. 
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First, let 

6* = max ( 1, - ) . (25) 



1, 

The parameter 9 depends only on parameters of the model since 7 depends only on the parameters of 
the model. 

Consider any initial state {q,zi,Z2) G x ?fi^_^'^. Let n = \\q\\. By Theorem El there exists a 
non-idling fluid solution {Q{t),f{t)) which satisfies 0(0) = q and ||0(t)|| > jt for ah t > 0. Since FDP 
is assumed then by Proposition ^ the solution {Q{t),T{t)) can be modified to a solution which satisfies 
properties described in Definitional Let 

6»o = e^llgll = ||g||max ^1, , (26) 

in which case we have 

110(^0)11 >3||g||. (27) 
By Theorem ini the fluid solution is also such that 

inf||Q(t)||>Mmin(2,l). (28) 

Since FDP is satisfied, there exists another solution {Q{t),T{t)) and a sequence = sq < -^i < • • • < 
sm = ^0) such that info<(<6)o ||'3(i)|| > info<t<6io ||Q(*)|| and for every interval [sr,Sr+i] and for each 
station a either Qa{t) is zero within (5^,5^+1), or it is strictly positive within {sr,Sr-\-i)- For simplicity 
we assume that {Q{t),T{t)) is this modified solution. In such a modified solution we also note that 

1 2 /C \ 

M<u9o sup \- B < z^6'o-n-rTmax — ,1 +B 

o<t<eo\\Q{t)\\ \\q\\ \7 J 

< 2zymax ^1, max ^— , 1^ +5 (29) 

where we used (|26() and H28|) . In particular, we obtain a bound on M which depends only on the 
parameters of the model (and is independent of \\q\\), since 1^,7 and C depend only on the parameters 
of the model. Note, on the other hand, that the partition Sr,r = 0,1, M does depend on q. Recalling 
the notation = n we rewrite (|27() and H28() as 

||0(?^^)ll >3||g|| =3n, (30) 

and 

^inf^J|W)||>|mm(ll). (31) 
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Our next goal is to describe a non-idling scheduling policy lA = h{{5) implemented over the time horizon 
[0, ^o] = [0, ^n]. Recall that our starting state is (5,21,22)- In particular, Q(0) = 0(0) = q. The policy 
lA attempts to mimic the fluid solution described above, over the same time interval. We parameterize 
the policy with a constant 5 > which is any constant satisfying 



Let tm = m6n for m = 0, 1, . . . , \0/6~\ . We describe the policy U on each time interval Im = [tm, tm+i)- 
For each time interval Im each station a nominally allocates Tij{tjn,tm+i) time units to serving class 
for every class (i,j) E cr. To be precise, we first order all the classes at a station in a fixed, but 
arbitrary manner. During the interval a class is chosen for service, and we work on jobs from 

that class for Tij{tm,tm+i) time units or until we exhaust the jobs from class (i,j). Note that we 
cannot reach the end of the interval 1^, by the feasibility of T(-) over this interval. When we are done 
processing jobs of type the next class in the chosen order of service is picked for processing. Note 
that we assume a preemptive resume mechanism when switching between classes. If after going through 
all the classes, the time spent is strictly less than tm+i — tm and there are still jobs at the station, 
the station works on any available jobs. If no jobs are available, the station idles. Once the next time 
instance tm+i occurs, the policy is "reset," in terms of the time allocations. 

In other words, according to our scheduling policy, on each interval Im each station tries to spend 
exactly the same amount of time on jobs in each class (i,j) as the fluid solution {Q{t),T{t)) does, 
while maintaining the non-idling requirement. Our main goal is to show that in general the resulting 
stochastic process stays fairly close to the fluid trajectory {Q{t),T{t)), when the stochastic network 
operates under the discipline U. 

^From the fluid equation ((TB|) we have Yl{i j)ea'^i,ji^m,'tm+i) < *m+i — tm, for each m. As a result, 
any policy U is feasible. From the description above, it is certainly non-idling. We now analyze the 
dynamics of our network when policy U is implemented. For convenience we introduce s„i = sq = 0. 

Lemma 8 Under the policy lA (in fact under any scheduling policy), for every m = 0, 1, . . . , [|]. 




(32) 




(33) 



and 




(34) 
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Proof : Applying ^ and ^ we have 

\\Q{t)-Q{tm)\\ < C^\ + ^l^i,J,){t-tm) < C{tm+l-tm) =C6n, 

i i 

which proves 1)33^ . We now prove ()34() . By Assumption B (specifically bound COI)), for every i and 
every t G [t^, Wi] 

¥{\Ai{t) - A,(t„,)| > 2Xi6n} < ¥ {\Ai{t„^+l) - Ai{tm)\ > 2X,5n} (35) 

< 0(exp(-e(n))), (36) 

since tm+i —tm = ^n. Similarly, for all i and j and t G [tm, tm+i] 

P{|Aj(t) - Dij{tn,)\ > 2fi,^,6n} < 0(exp(-e(?i))). (37) 

Applying and Q we obtain 

pi sup \Qij{t) - Q^jitm)\ > 2{Xi + + fiij)6n I < 0(exp(-e(n))). 

\tm.<t<tm+l J 

By summing these probabilities over all we obtain 

sup \\Q{t) - Q{t„,)\\ > (2j^AiJi + 4^^,,,)5nl < ^ 0(exp(-e(?i))) = 0(exp(-e(?i))), 
implying 

P J sup IIQ(t) - Q{tm)\ \ > C5n I < 0(exp(-G(n))), 

I tm<t<tm + l J 

which is □ 
A large part of the remainder of the paper is devoted to proving Proposition [21 below. The proof is 
quite lengthy and we split the argument into several subsections. 

Proposition 2 Under the policy U = U{5) for every r = —1, 0, 1, . . . , M — 1, every tm G [sr, Sr+i] and 
every class 

niQijitm) - Q^Atm)\ < 5C'+M > 1 " 0(exp(-e(n))) . (38) 

The proof is done by using various induction steps. The "outer" induction is on r, which indexes 
the trajectory decomposition points Sr- The "inner" induction is done on the stages j of the classes 
(i,j) classes in the network, and is outlined in various lemmas below. 
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We start the outer induction with r = — 1. Then for tm G [■5-i,so] = {0} we simply have tm = 
and the bound in (|38j) holds trivially for all classes since Q(0) = Q{0) = q, with probability one. 
Next we suppose the bounds in ()38() hold for —1, 0, 1, . . . , r — 1. We then show that the bounds hold 
for r. The necessary bounds will be established by a sequence of lemmas. Our first lemma simply says 
that assuming the bounds (PS]) hold for all r' < r — 1 and tm G [sr'i -Sr'+i]) a similar bound holds at the 
end point Sr- 

Lemma 9 // the bound i!^8\) holds for all r' < r — 1 then for every i,j 

^{IQijisr) - Qi,j{sr)\ > 6C''+^n + 25Cn] < 0(exp(-G(n))). 

Proof : Find the largest t^' < Sr- Then t^'+i = t^,' + Sn > Sr > t^'- By Lemma |S1 we have 
\Qi,j{sr) - Qi,j{tm')\ < C^n and 

r {\Qij{sr) - Qij{tm')\ > C6n} < 0(exp(-e(n))). 

Since t^' € [sr-ij Sr] then by the assumption of our induction in r, 

^{\Q^,J{^m') - Q^Atm')\ > C'+^Sn} < 0(exp(-G(n))). 

Combining the last three inequalities, we obtain the result. □ 
In the next subsection we obtain probabilistic lower bounds on the number of jobs processed during 
the time interval [sr,tm), for any tm G [srjSr+i], under the scheduling policy U{6). 

4.3.2 Lower bounds on the departure process 

The next lemma shows that, with high probability, in the first stage in the route of each job type the 
total number of jobs processed during the time interval [sr, tm] is not too far behind the amount of fluid 
processed during the same time interval in the fluid solution. A subsequent lemma establishes a similar 
bound for stages two and higher. Recall that we fixed r and we assume by induction that ({55)) holds 
for r' < r — 1. 

Lemma 10 For every i < I and every m such that Sj- < tm 1^ Sr+i; 

¥{Di^i{sr,tm) > D,^i{sr,tm) " 260"^+^} > 1 - 0(exp(-e(n))), (39) 

and 

¥{T,,,{sr,tm) > Ti^i{sr,tm) " 3/i„,ax<5C"+'n} > 1 - 0(exp(-e(n))). (40) 
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Proof : We start with proving bound ()39|) . Bound (|4U() will be an easy corollary. 

Part I. Fix a specific class (i, 1), and time tm^, Sr < imo ^ Sr+i, and introduce the event 

V{tmo) = {A,l(Sr,imo) < A,l(Sr,imo) " 26^+^71} . (41) 

Note then that is equivalent to having P {D{tmo)} < 0(exp(— 0(n))) for every i and tmo £ [■Sr, Sr+i]. 
Next, we introduce the events 

A= {y tm & [Sr, Sr+l] : Ai{Sr,tm) > Ai(tm - S^) - (5Cn} , (42) 



Q = {Qi,i(s.) > Qi,i{sr) - SC+^n - 25Cn] . (43) 
^From Lemma El and the inductive assumption we have 

F {Q} > 1 - 0(exp(-e(n))). (44) 

Now fix any £ [sr, s^+i] and consider 



¥{Ai{Sr,tm) > Xiitm - Sr) - SCn} = P <^ Ai{Sr, tm) > \{tm " Sr) - {tm - S-r) 

L '^m Sr 

where without loss of generality we may assume tm > Sr- If tm — Sr < Sn, then the probability above 
is equal to one, since the right-hand side of the inequality inside the probability is negative. Suppose 
now tm — Sr > Sn. We have 

5Cn 6Cn 5C 

> 



tm — Sr On 6 

Setting e = ^ and using the large deviations Assumption B with this e we obtain that 

^{Ai{sr, tm) > h{tm " Sr) " 5Cn} > 1 - 0(exp(-e(t™ - s,))) > 1 " 0(exp(-e(n))), (45) 

where tm. — Sr > Sn is used in the last inequality. The number of different tm in [•SrjSr+i] is at most 
9n/{5n) = 9/5. Summing over all such tm we conclude 

P{^} > 1 - (^/5)0(exp(-G(n))) = 1 - 0(exp(-e(?i))). (46) 

Hence 



Pp(tmo)} = P{2^(U,)MnQ}P{^nQ} + P{P(t„J|^nQ}P{^nQ} 

< P{L»(t„Jn^nQ} + 0(exp(-e(n))), 
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where in the inequahty we use fl Q} < 0(exp(— 0(n))) which holds by (|1H) and Thus to 

show (|39|) it suffices to prove 

F{V{tm,) nAnQ}< 0(exp(-e(n))). (47) 

We denote the event {Vitmo) n^n Q) by Vcitmo)- We first show that given Vcitmo), there exists with 
probabihty one a time instance tm with Sr <t,m < tmo , such that the fohowing events occur: 

ntm) = {Qi,l{tm) > SCn} (48) 

and 

G{tm) = { Di^i{tjn,tm+l) < /^i.lTi^i (t^, t^+l ) 7. > ■ (49) 



That is, we claim 

IP {^{m:s.<t^<t„.,}mtm.) H 0(1^)) \ Pc(tmo)} = 1- (50) 

On the other hand we also claim that for each tm € [sr, Sr+i] 

P {G{tm) I ntm)} < 0(exp(-e(n))), (51) 
which implies that F{J^(tm) H G{tm)) < 0(exp(— G(n))). Together with (|^n|) this would imply 



'{Pc(trno)} < 



POTm)ng(t^)} 



< 0(exp(-e(n))), 

where again for the last inequality we use the fact that the number of tm in the interval [sr, Sr+i] is at 
most 9/6 and 9/6 exp{—Q{n)) = exp(— 0(n)). We could then conclude that 1)47(1 holds and we would 
be done. Thus we need to show (|5U() and (|5H) . We start by proving (|51() . Note that during the time 
interval Im, policy U{6) either allocates at least Ti^i{tm,tm+i) time units to process class {i, 1) jobs, or 
all the Qi,i(tm) > 6Cn jobs initially present are processed. In the second case G{tm) does not hold since 
6Cn > fii^iTi^i{tm,tm+i)- In the first case, if Ti^i{tm,tm+i) < ^^.^g" , then Q{tm) obviously does not 
hold, since the right-hand side in the inequality in (|49|) is negative. Otherwise Ti^i{tm,tm+i) > 0(n). 
In this case, we can apply the large deviations bound ()l()j) which holds by Assumption B. Setting 
e = 25'^Cn/{fi^i{tm,tm+i)6) > 26C/0 in the bound we obtain: 

26'^Cn 1 

-Di,i(tm, Wi) < ^J■i,lTi^l{t„^,t„^+l) — > < 0(exp(-G (Tj^i (t^, Wi )) )) = 0(exp(-G(n))) 
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where in the last equation we use Ti^i{tm,tm+i) > Q{n) and as usual, 5, C and 6 are hidden in the 6(-) 
notation. We conclude that (|51|) holds. 

We now prove (|5Ujl . Note that if — Sr < ^it- then the right-hand side of the inequality in the 
event T>{tjno) negative and therefore the events 'D{tmo) ^^^'^ ^c(^mo) cannot occur. Thus we assume 
there exists at least one tm G [sr,tmo)- We have Di^i{sr,tmo) > I]{m:sr<t™^<t„Q_i} Wi) and 

A,l(Sr,imo) < X] A,l(im, Wl) < Di^i(tm,tm+l) + ^Cn. 

{m:Sr—5n<tm<tm.Q-l} {m:Sr<tm<tmQ-l} 

The event V^tmo) implies that there exists a tm & [sr,tmo-i] such that 

25C7^+2^ - 6Cn 











6n 




25C 


'■+2n - 6Cn 


{9/ 5) + 1 




6^C 



< fJ'i,lTil{tm,tm+l) ^ , r , (53) 

- 252Cn 

where we used — Sr < On in and we use in the fact that > 1 by (j^SJ, 5 < 1 by and 
as a result 6 + 5 <2e and (2C''+2 - C)/2 > (2C2 _ C)/2 > 2C. 

Among tm, e [sr,imo) select the largest m such that Di^i{tm,tm+i) < /ii,i7i,i(im; ^m+i) — ^"^g*^" and 
denote it by m. By the derivation above the set of such tm is non-empty. Thus, 

^ , , - , , 25^Cn 

Di^l[trintrh+l) < ^m+l) ^ • (54) 

Moreover, if m < uiq — 1, then for all m < m < nriQ — 1, we have 

Di^l[tm,trn+l) > fJ'i,lTi^i[tm, tm+l) ^ , 



or 

Di^l{tm+l,tmo) > fJ'i,lTi^l{tjf^^i,tmo) ^ > (^m+l j ^mo ) —25Cn, (55) 

where mg — m < 0/5 is used. Note, that the bound (|55|) holds trivially if m = mo — 1. Next, note that 
the event 'D{tmo) Jointly with implies 

('Sr ) ^m+l) — (Sr ) ^mo ) (^m+l i ^"lo ) 

< /Wi,iTi,i(sr,imo) - 25C"'+2j^ _ (^j iri i(t^+i,tmj - 26Cn) (56) 
= M*,ir*,i(5r, tm+i) - 25C'+^n + 2JCn. 
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Thus 

< fii,ifi,i{sr, tm+i) - 2(^C"~+2n + 25Cn 

< Hi,ifi^iisr,t^)-25C''-^^n + 35Cn, (57) 
where fii^iTi^i{trh,trh+i) < fJ'i,iSn < 5Cn is used. Now recall from (0) that 

Qi,litrh) = Qi,l{Sr) + Ai{Sr,trh) - -Di,l(Sr, im)- (58) 

Then conditioned on Pc(^mo) = ^(^mo) H ^ n Q and using (|57|). we obtain 

Qi i(i»?i) > Qi,i('Sr) + Aj(tm — •5,.) — /Uj^iTj^i (s^ , im) " SC'^'^'^n — 25Cn — 5Cn + 256"" """^n — 3(5Cn. 

Recall from (fT^ that (5i,i(s.r.) + Aj(tm — ■Sr) — /^i,i^i,i('5r5 ^m) = Qi,i{'tr'n) ^ 0. Then 

Q»,i(tm) > <9i,i(*A) + <5C^+^n - 65Cn > 5Cn, (59) 

We have established that if the event Vcitmo) holds then and hold for some tm < tmo- In 
other words, 1(50]) holds. This completes the proof of (jSHl). 

Part II. We now prove (|4Up . Fix a £ [•5r; s^+i]. Note that the bound (|4U() is trivial if Tj,i(sr, im) < 
^fJ-ma.K^C'"'^'^'''!'. So, suppose the previous inequality does not hold. Let 

A = fii,iTi,i{sr,tm) - 25C'+^n > 5C'+^n > G(n), (60) 

where we use //j,i^max > 1- Let 

5Cn 6 

where we use A < fii^iTi^i{sr,tm) < C9n. We condition on the event 'D{tm), which by H39() holds with 
probability at least 1 — exp(— 0(n)) and use large deviations Assumption B with the e above to obtain 

P{Ti,i(s„t^) > fi;j(^fii,ifi,i{sr,tm) - 25C'+^nJ - 5Cn | P(t™)} = 
P {Ti,i(s„ t^) > /ir^A - eA | £>(s„ t^) > a} > 

l-0(exp(-e(A))) > 
l-0(exp(-e(n))), 

where the last inequality follows from the last inequality in (|6flj) . To finish the argument, we observe 
that ^iTl25C'-^'^ + 5Cn < Sfi^ai^JC'+^n. □ 
We now establish a similar lower bound for classes corresponding to stages two and higher. 
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Lemma 11 For every i < I, j < Ji and m such that Sr < ^ ■Sr+i 

P{Aj(s,, t^) > Aj(sr, tm) - 26jC'-^^n} > 1 - exp(-G(n)), (61) 

and 

P{T,j(s„ t^) > t,j(s„ t„) - 3/iinax5jC"^+^n} > 1 - exp(-e(n)). (62) 

Proof : The proof is very similar to the one for Lemma E3 We only highlight the differences. The 
proof is done by induction in j; the base case j = 1 is covered by Lemma ITOl So let us fix a j > 1 and 
assume that the assertion holds for all with j' < j — 1. We again define an event related to the 

inequality inside P in (|6ip . For a class and any time tmo with Sr < tmo ^ Sr+i let 

V{tmo) = {Dij{sr,t^) < Dij{sr,tm) " 26jC'-+\}. (63) 

We need to show P{P(imo)} !^ 0(exp(— 0(n))) for every tmo ^ i^r, Sr+i]- As in Lemma ITfil we introduce 
the event 

Q = {Qijisr) > Qijisr) - 6C'-+^n - 26Cn} , (64) 
but instead of the event A defined by consider 

'D= {ytm^ [Sr,Sr+l] : A,j-l(Sr,im) > Aj-l(Sr,im) " 26{j - l)C"'+^n} . (65) 

Again using Lemma |^ (and the "outer" inductive assumption) we obtain P{Q} > 1 — exp(— 0(n)) 
and by the inductive assumption on j, ¥ {D} > 1 — 0(exp(— 0(n))) (where, as before, we sum several 
expressions of the order 0(exp(— B(n))) over t^ € [srjSr+i] to get again 0(exp(— 0(n)))). Next, let 
'Dcitmo) = ^(imu) nQnV. We need to show P {P^ (tmo)} < 0{exp{-Q{n))). For every tm G [sr,tmo], 
we introduce the event J^itm) as in except Q^j is used instead of Qi i- Finally, we introduce Q{tm), 
defined as follows 

r - 26^Cnj \ 

Arguing as in the proof of Lemma ITUl we claim that H5(J|) and (|51() hold with the new event definitions. 
The proof of H51|) is identical to the one of Lemma ITUl For (|5U|) we repeat the argument until we get to 
(fS7|l , instead of which we get 

Dij{sr,tm) < f^i,iTij{sr,tm) - 2j(5C""+^n + 35Cn. (66) 
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Then we obtain 

Qijitm) = Qij{Sr) + Dij_i{Sr,trn) - Di,j{Sr,tm) (67) 

- 5C''+'^n - 25Cn - 26{j - \)C'^'^n + 2bjC'^'^n - 35C7n (68) 
= Oi,i(im) + <5C"^+^n-5(5Cn (69) 
> bCn, 

where (jU is used for l|H7|) . conditioning on Vcitm^) is used in and ((T^ is used in (jHH). This proves 
(|5U|) and completes the proof of (|61|) . The proof of the lower bound for Tjj(-) follows the proof of 
Lemma [TUl almost line for line. □ 

4.3.3 Upper bounds on the departure processes 

In this subsection we obtain upper bounds, similar to the bounds in Lemmas 1101 and II H on the cumu- 
lative departures Dij{sr,tm), for values of m such that Sr < tm < Sr+i- 

For every station a, by construction of the sequence sq, si, . . . , sm, we have either Qait) > for all 
Sr < t < Sr+i or Qa{t) = for all Sr < t < Sr+i- We consider these cases separately. 

Lemma 12 Given any station a, suppose the interval {sr, Sr+i) is such that Qa{t) > for all Sr < t < 
Sr+i- Then, for every class {i,j) G a and every tm G [sr.,Sr.+i] 

P{T,,j(s^,t^) < f,j(s„t^) + 35|(7|^maxJma.C"^+^n} > 1 - 0(exp(-e(?i))), (70) 

and 

P{Aj(s.,tm) < Di^j{sr,tm) + ^5\a\iil,,,J^^^C'+^n} > 1 - 0(exp(-e(n))). (71) 

Proof : Given any station a, suppose that Qa{t) > for all Sr < t < Sr+i- By the non-idling 
constraint (|20j) we have that 

Tij{Sr, Sr+l) = Sr+1 — Sr- (72) 

Fix any tm G [sr,Sr+i] and fix any class (i,j) G cr. Applying Lemmas 1101 and II II to Sr and tm we have 
that with probability at least 1 — 0(exp(— 0(n))), for every class {i',j') G a, 

'-^i' ,j' i^r 1 ^m) — Ti' ,j' {Sr,tm") /^maxC* ri ^ Tj^r ji (^Sri '^^ l^ma.xJmaxC' n, 
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where we use ((TJ in the second inequahty. Applying ((7^ and the feasibiHty inequahty (jlj), we obtain 
that with probabihty at least 1 — 0(exp( — 0(n))), 

(*j)7^{«'j')G<T 



(*j)7^(*'J')GfT 

Let us define the event T as follows: 

that is F{T} > 1 - 0(exp(-e(?i))) per ((ZHl). Next, consider 

P { Aj(Sr-, tm) > lJ'i,jfij{Sr,tm) + 4(5|(T|/i^j,x JmaxC"'+^n | T} < 
) > fJ-ij{Tij{Sr,tm) + 3(5|cr|;Umax^maxC"'+^n) + (5|cj|^^j,x JmaxC'+^n | T} . 

Applying the large deviation bound with 

'^I'^l/^max'^iiiaxC ~'~ 'T- ^ '^l'-''l/^max'^iiiaxC' 



Tij{Sr,tm) + 35|a|^max-'^maxC''+2re 6* + 35 1 CT | /Xmax JmaxC"'+2 ' 

(where Tij{sr,tm) < is used), we obtain 

exp ( - G {fij{sr,tm) + 3(5|o-|/imaxJmaxC"""'"^n) ) < exp(-G(n)), 



where the constant e is hidden in G(-). Taking this together with P{T} > 1 — 0(exp(— 0(n))), we have 
proven the lemma. □ 
We now analyze stations a for which the fluid amount stays zero during the interval [sr,Sr+i\- In 
the following lemma we obtain an analogue of Lemma WH for this second case. 

Lemma 13 Given any station a, suppose the interval (sr,Sr+i) is such that Qa{t) = 0, for all Sr < 
t < Sr+i- Then for every {i,j) € a and every t^ G [s^, s^+i] 

F{Dij{sr,tm) < Dij{sr,tm) + bdjfil^JJl^^C'+^n} > 1 - 0(exp(-e(n))). (74) 

Proof : 

Consider any station a such that Qa{t) = 0, for all Sr < t < Sr+i- Applying fluid equations ()12() 
and (|13|1 we obtain that for every class (i, j) € a and every tm € [srj Sr+i] 

D'i^j^li^Sritm) — Dij(^SrjtYii), C^^) 
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where for the case j = 1, Dij-i{-) is understood as Ai{-). 

The proof now proceeds by induction in j. We start with the base step, j = 1. So, consider any 
class E cr. Applying ((7^ . we have 

A,l(Sr,im) = AiSr,tm)- (76) 

Applying we have 

Qi,l{tm) = Qi,l{Sr) + Ai{Sr:tm) - -Di,l(Sr, ^m) > 0. (77) 

Next, let tm' = niax{m : tm < Sr}- In particular, < Sr — im' ^ f^^^- We then have 

¥{Ai[sr,t^) > Ai{sr,t^) + 26Cn} < F{Ai{t^,,tm) > Ai{sr,tm) + 26Cn} (78) 

< F{Ai{tm',tm) > Aiitrn' +Sn,trn) + 26C7l} (79) 

< F{A,{tm',tm)> Mt„,>,tm)+6Cn}, (80) 

where Ai{tm',tm' + Sn) < XiSn < C5n is used in H8U|) . Note that when t^/ = tm the probability in 
(|8()|) is zero since the left-hand side is negative. Thus we assume tm' > tm- Let e = 5Cn/[tm — tm') > 
6Cn/{9n) = 5C /9 > 0. Using the large deviations Assumption B with this e we obtain 

¥{Ai{tm',tm) > Ai{tm',tm) +SCn} = P{ (t„/ , t„,) > Ai{tm' ,tm) + e{tm - tm')} 

< 0{exp{-e{tm - tm'))) 

< 0(exp(-e(n))), 

where tm — tm' > is used in the last inequality. Combining this bound with (|8()|) we obtain 

V{Ai{sr,tm) > A,{sr,tm) + 26Cn} < 0(exp(-e(n))). (81) 

Applying Lemma IHl we have 

P{Qi,i(sr) < Qi,i{sr) + SC+^n + 26Cn} > 1 - 0(exp(-G(n))). 

By our assumption that Qa{t) = for all Sr < t < s^+i and by continuity, we have Qa{sr) = 0. Using 
this fact, we now have 

P{Q»,i(sr) < 5C'+^7i + 26Cn} > 1 - 0(exp(-G(n))). (82) 

Now, from (f77|) . we have 

■Di^l{Sr,tm) = Qi^l{Sr) ~^ Aii^Sfitm) Qi.litm) 
< Qi^liSr) + Ai{Sr,tm). 
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Applying l|8H) and (|82() we obtain that with probabiHty at least 1 — 0(exp(— 0(n))), 

D^,l{sr, tm) < Msr, t^) + 25Cn + dC'+^u + 25Cn < Msr,t„,) + bSfii^JJl^.C^'+^n. 

Combining this with H76() . we obtain the required bound. This completes the proof of the base step. 

We now prove the inductive step. So, fix j > 1 and suppose that the assertion holds for 1, 2, . . . , j — 1. 
We now consider a particular class G cr. We have from 

Qijiim) = QijiSr) + Dij_i{Sr,tm) - Dij{Sr,tm) > 0. (83) 

Again, by Lemma 1^1 we have 

^{Qijisr) < Qi,j{sr) + -5C"^+^n + 25Cn} > 1 - 0(exp(-e(n))), 

which implies 

P{Qij(sr) < -5C"^+^n + 26Cn} > 1 - 0(exp(-G(n))), (84) 

again since Oo-(sr) = 0. 

Consider the station a^' containing (i, j — 1). If a^i is also such that Qa'{t) = for all Sr < t < s^+i 
(for example when i^' = v), then by the inductive assumption on j, 

P{A,,_l(s.,t„,) < A,i-l(Sr.,tm) + 55(j - l)/iLx^^max^^'+'^} > 1 " 0(exp(-e(n))). 

Otherwise, 0",^/ is such that Qa^,{i) > for all Sr < t < Sr+i- Then Lemma IT^ becomes applicable, and 
applying ((7T|) to a,y', we have that with probability at least 1 — 0(exp(— 0(n))), 

< A,i-i(sr, im) + 5(i - l)6fii^JJl^^C'-+^n, 

where we use \cru'\ ^ ^i^i — Umax and j > 1. Hence, in either case we have a probabilistic bound 
on Dij-i{sr,tm)- Combining this with (jHHl) and (jHU we obtain that with probability at least 1 — 
0(exp(-e(n))), 

D^,j{sr,tm) < A,i-i(sr, tm) + 6C'+\ + 26Cn + 55{j - l)fil,JJl,^C''+^n 
< A,,-l(Sr, ^„^) + S{3 + 5(i - l)f,i,JjLjC'+\ 

Finally, recalling (|75() we obtain the desired bound. This completes the proof of the inductive step. □ 
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With the lemmas above in hand, we are now ready to finish the proof of Proposition[2J by completing 
the outer inductive step on r. 

Proof : [Proof of Proposition [2] 
Fix any tm G [sr.,Sr+i]- By Lemma El 

^{\Qi,j{sr) - Qi,j{sr)\ < SC'+^n + 2SCn} > 1 - 0(exp(-e(n))). 

Next, for any class recall that we have 

Qijiim) = QijiSr) + Di,j-l{Sr,tm) - Di,j{Sr,tm), (85) 

with Z)jj_i(-) replaced by Aj(-) when j = 1. Combining Lemmas 1 1 n| 1 H 1 2l and El we obtain that, 

¥{\Dij{sr,tm) - D,j{sr,tm)\ < 5j 6 fil^J Jl,,C^+^n} > 1 - 0(exp(-e(n))) . 

Recalling ()45() and 1)811) we have that 

F{\Ai{sr,t,n) - Ai{sr,tm)\ < 26Cn} > 1 - 0(exp(-e(n))). 

Combining the previous two bounds with (|85() and the fluid analogs ()1'2() and 1)13(1 we obtain that, 
with probability at least 1 — 0(exp(— 0(n))), 

\Qi,,{tm) - QiAtm)\ < SC^+^n + 26Cn + W5jfii,JJl^,C'+^n < 5C'+^n, 

where the bound (jSJ is used. This completes the proof of Proposition [21 □ 

4.4 Proof of the Main Theorem 

In this subsection we present the final two proofs. The next theorem is last result needed before proving 
Theorem |71 

Theorem 14 Suppose the fluid model of a stochastic multitype network is not globally weakly stable 
and satisfies the FDP property. Then for any initial state Q(0) = {q,zi,Z2) G Z+ x , under the 
non-idling scheduling policy U we have 

P{||Q(0||g||)|| >2||<?||} >l-0(exp(-e(||(?||))), (86) 

and 

l0<t<6»||g|| 4 \C 



inf ||g(t)|| > ^ max ( ^, 1 ) !> > 1 - 0(exp(-e(||(/||))). (87) 
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Proof : We first prove (|57j) . Fix any tm and find the Sr such that tm S [sr, Sr+i]- We have 
pj sup \\Q{t)-Q{t)\\>3C''+^5n\ < pJ sup \\Q{t) - Qit„^)\\ > C6n\ 

I i?7i<i<im+l J I im<i<tm+l J 

+ P{||g(U-0(tm)ll >C'^+'5n} 

+ pi sup WQitm) - Qim > C5n[ 

I I'm 

< 0(exp(-e(n))). 

In fact, observe that the last probability in the right-hand side above is equal to zero by H33|) of 
Lemma ISl The first probability in the right-hand side is at most 0(exp(— 0(n))) by H34|) of Lemma El 
and the second probability is also at most 0(exp(— 0(n))) by (|38j) of Proposition |21 and the fact that 

EJi<c. 

Combining the inequality above with H31|) we obtain 

inf ||Q(t)|| < -minf^,l) - 3C''+^6n\ < 0(exp(-e(?i))). 



^From H32|l and since r < M — 1 we have 



Thus 



- min Ij - 3C^^-5n > - min 1 ) . 



inf ||Q(t)||<5min(^,l)l<0(exp(-e(n))). 

tm<t<tm. + l 4 U ) 

By summing over all m = 0, 1, . . . , [0/(5] we obtain 

^m|^J|Q(t)||<^min(^,l)|< ^ 0(exp(-e(n))) = 0(exp(-e(n))), 

where the last equality follows since by and the value of 19/51 is bounded above by a constant. 
Recall, finally, that ||g|| = n. This completes the proof of (|87j) . 

We now prove (|86|) . Find the largest tm < 6'n. In particular On — tm < 5?^- Applying with 
t = On, we obtain 

P{||Q(0?i) - Q{tm)\ > CSn} < 0(exp(-G(n))). 
Applying (PS]) at t = On we obtain 



||Q(0n)-g(t„,)|| <C(5n. 
Applying (|HH|l to the tm chosen above we obtain 

n\Qi,ji*m) - Q^Atm)\ > 5C^'+^n} < 0(exp(-e(n))). (90) 
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Next, we note that 



F{||<3(*,„)-(3(*„,)|| < 



p u 




gCM+3 



n 




p u 



Qiji^rn) Qi,j{tm)\ > 



n 



< 



C 




< 



< 0(exp(-e(n))). 

In the last step, we employ (|90p and then sum over all i and j to obtain a new exponential bound. 
Combining (|S5|) . (ISU]) and the last bound, we obtain 

¥{\\Q{9n) - Q{en)\ \ > 3SC^'+^i} < 0{exp{-Q{n))). 

Since 5 < l/(3C*^+3) we obtain: 

¥{\\Q{n9) - Q{ne)\\ > n} < 0(exp(-G(n))). 

Recalling from (|3n|l that > 3n and recalling = n, we obtain 

P{||Q(n0)||<2||g||}<O(exp(-e(n))), 

which implies ()86() . This completes the proof of Theorem 1141 □ 
It should be noted that the constant "2" which appears in (|86() is completely arbitrary. In all of the 
proofs in which the constant appears, it can be replaced by any constant greater than unity. We are 
now ready to prove our main result. 

Proof : [Proof of Theorem [7] We fix a large value no (the actual value will be specified later) . 
Consider any initial state {q,zi,Z2) with j|g|| > no- We apply the policy U for the time interval [0,0q] 
where 6q = 6\\q\\. If at time Oq the resulting state Q{9o) is such that ||Q(0o)|| ^ 2no, then we apply 
the policy U again with q reset to Q{Oq), till the corresponding time = + ^j|Q(^o)||- If again 
||Q(^i)|| > 2| 1(5(6*0) 1 1 > 4no, we continue with policy U until the corresponding time 62 and check 
whether ||Q(^2)|| > 2||Q(0i)|| > 8no, and so on. Either this process continues indefinitely or for some 
time instance 6i we get ||Q(^j)ll < 2||(5(^j-i)||. Set = by convention. Let £m,fn = 0,1,..., 
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denote the event \\Q{9i)\\ > 2||Q(6'j_i)|| and 

^^_j„f^^||Q„||,M (01) 

for all i < m. In particular, the event implies ||Q(^m.)|| ^ 2"^^^nQ > uq. Let £^ = rim£m., that 

is £^ implies that the process of exceeding the bounds continues indefinitely. We now show that 

> a > 0, where a depends only on the parameters of the model and on no and 7 (and is 

independent for example from the components zi, 2:2). By (|5H|l and (|57)) of Theorem [T^ the probability 

of the event £^ = n^^g'^j is at least 

00 00 
l-2^0(exp(-e(2-||g||))) > 1- J^O(exp(-e((m + l)||g||))) 

m=0 m=0 

^ 0(exp(-e(||g| 



l_0(exp(-e(||(z 
> 1 -0(e-®("°)). 

We take no sufficiently large so that a = 1 — 0(e~®^"o^) > 0. The parameters hidden in B(-) depend 
only on the parameters of the model (including the large deviations parameters V, L) and 7. Thus the 
probability of £^ is positive (and in fact is close to unity), provided that no is sufficiently large. 
Next, we show that the event £^ implies 



lim inf ^lAi^ > —yc^-; > o_ (92) 

t t -8max(l,|) 

We first show by induction in m that event £^ implies \ \Q{0m)\\/0m >l/0 for ah m > 1. When m = 1 
the ratio is at least 2| |/(0| |) > 1/9. Suppose the assertion holds for i = 1, 2, . . . , m — 1. Note that 
Om = + ^||Q(e™^i|| and by £\ ||g(0„)|| > 2||g(0^_i)||. Therefore 

\\Q{Ora)\\ ^ 2||Q(e„_i)|| 



9m-l + 0\\Q{em-l)\\ 
2\\Q{9r,^-l)\\/em-l 



i + e\\Q{e.^.i)\\/e^.i 

But by the inductive assumption ||Q(^m-i)||/^m-i ^ 1/0. This immediately implies that the expression 
above is also at least 1/0, and the induction is completed. Now for every t > 6q = 0\\q\ \ we find 0,^ such 
that 0m~i 1^ t < 9m. Using (|9T|) we obtain 

mm ^ \m^m^i)\\ ^^^f 7 a 

~^-^e;;, max^-,lj 

— max — , 1 



4(0„_i/||Q(0™„i)||)+40 \C 
max 1) 
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where the last inequahty follows since \\Q{6m-i)\\/0m-i > 1/^- This shows 

Now, suppose the event £i fails to occur at some 6i, and thus £^ does not occur. We then "restart" 
the process of attempting to obtain an infinite sequence of points 6i with the properties outlined above. 
Let us call S"^ the event that the that sequence is obtained after restarting the process again as follows. 
At that time at which £i fails, we switch to any non-idling non-preemptive scheduling policy. Applying 
Assumption C, with probability one there exists a time ri for which ||Q(ti)|| > ng. Note that it is 
possible that ti = 9i. We apply the policy U starting from time ri. Repeating the argument for 

with probability greater than a we obtain a new infinite sequence of time instances 9[ such that 
— i-^- occurs. If £^ does not occur we again restart the process. Finally 

the probability of eventually obtaining a sequence of points 6i with the stated properties is given by 
F{£) = P(U^i£'''), where the £'' are defined as above in the natural way. Since the probability of each 
event £^ is bounded below by a, and this lower bound on probability does not depend on whether or 
not the other events occur, the probability of £ is one. 

Finally, we show below that the event £ implies ()22() . i.e. 

. r \\Qit)\\ max(^,l) ^ ^ 

liminf ITlUll > > q. 93) 

t t -8max(l,|) 

Let k be the smallest integer for which £k occurs. Denote by the time corresponding to the beginning 
of this event. Fix any state (g, zi, Z2) and to > and condition on = to, Q(to) = Q- Applying (|^^ to 
the event £k we obtain 

HQmil max(^,l) ^ ^ 

liminf "^^ ^" > > 0. (94) 



Since to is fixed, the lower bound holds as well. Integrating over the choices of {q, zi, Z2) and to we 
complete the proof of the theorem. □ 



5 Conclusions and Further Work 

The present work leaves many interesting questions open. The most immediate one is whether the result 
connecting global weak stability and rate stability holds for networks with any number of stations. One 
way to prove this conjecture would be to establish the Finite Decomposition Property for fluid networks 
with more than two stations. Of course the question of whether (strong) global stability of the fluid 
model is equivalent to positive Harris recurrence remains open even for networks with two stations. 
There the difficulty lies in begin able to analyze the dynamics of the stochastic network at the critical 
regime p* = 1. Finally, we mention that our assumption that interarrival and service times are i.i.d. is 
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used to simplify the exposition and our result should hold for networks with more general primitives as 
long as the associated processes satisfy appropriate large deviations bounds. 
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A Appendix 

Proof : [Proof of Lemma ^ We begin by proving @. The proof of UlUj) is then derived using ® . Our 
method uses the standard derivation of LD upper bounds on i.i.d. sequences. 

Part I. Let us fix arbitrary e > and 6 > 0. Then we note that the following hold for all n > 1: 



Zi > na + ne + z 



l<i<n 



Zi>z\ = P{e^^i<»<"^' > e^(""+"^+^) I Zi > 4 



< 



< 



gn9(a+e) 

F(0)(E[e''^2])n 



gn0(Q+e) ' 

where we use z > and E[e^^^] > 1. It is a standard result in large deviations theory Jl] that 
^^ez2y^e[a+e) = ^-L{e) ^ ;l for some value of 6^ = e{e) € [0,6*0] as long as K[e''^^] is finite on [0,60]. 
Thus our tail probability is at most F(0(e))e^^(^)". We fix a suitable 9 and take V = F{9). 
We now prove a complimentary bound. Again fix arbitrary e > and 9 > 0. 



Zi < na — ne + z 



l<i<n 



E[e-^(^i-^)|Zi > z](E[e-^^2])n-i 



< 



- g-{n-l)e{«-e) ^ ' 

where we use E[e~^(^i-^)|Zi > z] < I. A gain we use a standard result in large deviations theory 
[m stating that E[e-^^2]/e-(9a-eE) = g-L(.) ^ ;l for some value of 6* = 9{e) G [0,6*0]. We take 
V = e^(^)+eo^-de ^ Tj^jg proves ©. 

Part II. We now prove H10|) . Consider a fixed, but arbitrary e > 0. 

We first obtain a bound which is valid for all t > 1. Note that @ easily implies two one-sided 
versions of the LD inequality. Applying one such one-sided version of @ with n = \t/a + et \ > 1 and 
e = a^e/ (1 + ae + a) > 0, then there exist L, Vi > such that: 

\t/a+et\ \ 

Zi- z <a\t/a + et'] -e\t/a + €t] Zi > z i < 1/16-^^*/"+^! ^ 
i=i J 

for all t > 0. Next since \t/a + et] > t/a + et and for t > 1, \t/a + et] < t/a + et + t we have 

■ It/a+et] 

Zi- z <a[t/a + et]-e[t/a + et + t] 



i=l 
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for all f > 1. Multiplying through inside the probability yields: 

^ Z,-z<t + aet-aet Zi > z \ < Vie-^^^^°'+'^'^ . 

Further simplification gives: 

( [t/a+et] 

Zi>z\< 14e--^rt/"+rfl^ 



[t/a+et] 

Zi<t+. 
1=1 



for all t > 1. Using the duality relationship between a counting process and its increments, the above 
implies: 

P {N{t + z)> t/a + et\Zi>z}< l4e~-^rt/"+^il . (95) 



Finally setting we have Li = L{l/a + e), 



for all i > 1. Hence, we can rewrite ()95|) as 



Lit 



P {N{t + z)> t/a + et\ Zi>z} < Vie'^^ 
for all t > 1. 

For t < 1 and any V2 > 1 note that V2 ■ exp(— L2t) > 1 if we set L2 = In V2 > 0. Hence, 



(96) 



' {N{t + z)> t/a + €t\ Zi>z} < V2e 



-L2t 



(97) 



holds trivially for all t < 1 with such a V2 and L2- Finally, setting V3 = max{yi,V2} and L3 = 
min{Li,L2}, then combining with and (|!r7|) we obtain: 

P {N{t + z)> t/a + et\Zi>z} < V^e'^^^ 

for all t > 0. 

This proves one side of the inequality in (|1U|) . The other direction is proved by an exactly analogous 
argument. The final result is then obtained by combining the two directions, applying Boole's inequality 
and again using appropriate constants B and L. 

□ 
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